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MOMENT INEQUALITIES FOR U-STATISTICS 1 

By Radoslaw Adamczak 

Polish Academy of Sciences 

We present moment inequalities for completely degenerate Ba- 
nach space valued (generalized) U-statistics of arbitrary order. The 
estimates involve suprema of empirical processes which, in the real- 
valued case, can be replaced by simpler norms of the kernel matrix 
(i.e., norms of some multilinear operators associated with the ker- 
nel matrix) . As a corollary, we derive tail inequalities for U-statistics 
with bounded kernels and for some multiple stochastic integrals. 

1. Introduction. The extensive body of work concerning U-statistics 
which emerged during the sixty year period following their introduction by 
Hoeffding has lead to an abundance of results including limit theorems and 
tail inequalities as well as statistical and combinatorial applications. Most 
of the results correspond to the classical theorems for sums of independent 
random variables, exploring the properties of U-statistics under assumptions 
which are necessary and sufficient for such sums. Although in some cases, 
such as CLT, those conditions turn out to be necessary and sufficient also for 
U-statistics, for other problems (like SLLN or LIL) the case of U-statistics 
is much more complicated and the classical methods of proofs (in particular 
the existing tail and moment inequalities) are too weak. The properties of 
U-statistics depend on the so-called order of degeneracy and the most trou- 
blesome is usually the completely degenerate or canonical case to which other 
problems can be reduced by means of Hoeffding decomposition (see [10]). It 
turns out that, already for canonical U-statistics of order 2, what matters is 
not only the L 2 - and L°°-norms of the kernels, but also some more involved 
norms such as norms of certain operators corresponding to the kernel ma- 
trix, as one can see when examining the inequalities by Gine, Latala and 
Zinn [5]. These quantities have also been reflected in the necessary and suf- 
ficient conditions for the LIL for canonical U-statistics of order 2, obtained 
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in [6], and in precise moment estimates for Gaussian chaoses given recently 
by Latala [9]. 

In this paper, we generalize the results of [5] to canonical U-statistics 
of arbitrary order. The organization of the paper is as follows. First, in 
Section 2, we start from U-statistics with values in a Banach space, then 
specialize to type 2 spaces. All estimates presented there are expressed in 
terms of suprema of empirical processes and may be considered counterparts 
of similar inequalities for Gaussian chaoses due to Borell [3] and Arcones and 
Gine [2] (see also [1]). The main results are contained in Section 3, where we 
obtain sharp estimates for moments and tails of canonical U-statistics in the 
real-valued case. Those estimates involve "deterministic" quantities only and 
are optimal up to constants and logarithmic factors. Finally, in Section 4, we 
give analogous tail inequalities for multiple stochastic integrals of bounded 
deterministic functions with respect to stochastic processes with indepen- 
dent increments and uniformly bounded jumps, in the spirit of inequalities 
obtained by Houdre and Reynaud-Bouret in [7]. 

2. Estimates involving suprema of empirical processes. 

2.1. Basic definitions and notation. Let I n = {l,...,n} and consider a 
measurable space (£, T) (throughout the paper, we will assume it is a Polish 
space with the Borel a-field) and (hi) ieI d, a multi-indexed matrix of mea- 
surable functions /i; : S d — > B, for a separable Banach space (B, \ • |). Con- 
sider also a matrix (X^ ^)iei n ,jei d of independent S-valued random vari- 
ables. To simplify notation, let hi also stand for h\ ( X^\ . . . , ) , where 
i = (ii, ■ ■ ■ ,id)- Assume that h\ are canonical (completely degenerate), that 
is, Ej/i; = for all j < d, where Ej denotes integration with respect to 
= {X^)i£j n [for / C I d , we will similarly denote by Kj integration with 
respect to (X^)i e i n j<zj]. Let us define a random variable 



Our aim is to find precise estimates for the moments of Z. To this end, 
for J C I C I d (not necessarily nonempty) and a fixed value of i/c , let us 
introduce the following definition: 

Definition 1. 




iei d 



iei d 
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(1) 



/&') = (/&">, . . . , /£>), : E - R,j G J, i G /„ 



(i) . ■ 



EEl/i W (^ W )l 2 ^UejJ 



for 1^0. Let us further define |||(/ii)i e 



N 



Remark. It is worth noting that |||(/ii)i|||/ d ,0 = IEEi^i|- Moreover, for 
J C I = I d , |||(/ii)i 7 |||7,7 is a deterministic quantity (even a norm), whereas 
for I / Id, it is a random variable depending on (X^)kel°- 

Remark. Throughout the paper, we use the letter K to denote universal 
constants, for constants depending on d only and Kd{B) for constants 
depending on d and some characteristic of a Banach space B. In all these 
cases, the values of constants may differ between occurrences. 

2.2. Inequalities for Banach space valued U-statistics. 

Theorem 1. There exist constants such that for p> 2, we have 

(2) E\Z\ P <K P 



ni\\\l,j 



The main ingredient of the proof of the above theorem is the following 
lemma which is a corollary of Talagrand's tail inequality for empirical pro- 
cesses [12]. 

Lemma 1 ([5], Proposition 3.1, see also [4], Theorem 12). Let Xi, . . . ,X n 
be independent random variables with values in (S,^ 7 ) and T a count- 
able class of measurable real functions on E such that for all f G T and 
i G I n , Kf(Xi) = and Kf(X,i) 2 < oo. Consider the random variable S : = 
su P/erlEi/P^)l- Then for all p>\, 



ES P < K p 



where 



max sup \ f(Xi)\ p 
1 far 



a 2 = sup£E/pr,) 2 . 



To prove Theorem 1, we will need the following simple corollary of Lemma 1. 
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Lemma 2. Let B be a Banach space for which there exists a countable 
set D = {ifjj} of Junctionals such that for all x £ B, 

\\x\\ B = sup\tpj(x)\. 
j 

Now, let Xi, . . . , X n ,Y be independent random variables with values in 
Let E = Ly(B), the space of all B -valued, integrable functions of the form 
f(Y) such that ipj o f is measurable for all j . Consider functions hi-.Y? — > B 
(i = 1, . . . ,n) such that ipj o hi is measurable for all j, Kxhi(Xi,Y) =0 F- 
a.e. and hi(Xi,Y) £ E X-a.e. Let S = J2i h i( x i, Y ) G E - Then for allp>2, 



ms\\> E <K* 



<K P 



{MSWeT +P p/2 o- p +P p E x max \\hi(X u Y)\\ p E 



m\S\\E) p +P p/2 <T p +p p Ex 1 E\MXi,Y)\\ 



where 



a = sup Ey sup 

/=(A(*i)):£ E /P(*i)<l 3 

<Eysup(^E x ^(^(^,n) 5 



Y i ^xM h i(Xi,Y)fi(X i )) 

i 

\ 1/2 



Proof. First, we will construct a countable set of vectors of the form 
<f>(Y) = Oi(Y), <h(X), ■■■) such that Ej \<t>j(X)\ = 1 a - e - and for a11 9( Y ) G E > 



(3) 



I g(X)\ I e = sup 



5>y^(F)^( 5 (F)) 



Note that for every random variable k(Y) = (ki(Y), . . ., k n (Y)) G L y 



1 /«n 



there exists a vector 4>(Y) = ((pi(Y), . . . , 4> n (Y)) such that 
(4) 
and 



£ 1^-001 = 1 a.e. 

3=1 



E max | jfej (F) | 



^E^(y)^(y) 

i=i 



since for each value of Y, we can put <j>i(Y) = sgnki(Y), if I = min{i < n: 
\ki(Y)\ = maxj< n |/cj(y)|} and 4>i(Y) = 0, otherwise. Since all such sequences 
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4>(Y), treated as functionals on Ly(^), have norm 1 and Ly(£^) is sepa- 
rable (here, we use the assumption that £ is a Polish space), there exists a 
countable set T n of vectors <j)(Y) satisfying (4) such that 



Emax = sup 

3< n <t>eT n 



for all k(Y) 6 £y(C)- Now, for g(Y) e J5, 



||#(Y)||e = supEmax|V>j(sQO)| = sup sup 

n ]<n n e T n 



so, to obtain (3), it is enough to take a set consisting of all vectors <j>(Y) 6 
{JT n completed with zeros to vectors of infinite length. 

We thus have 5 = sup^ | Ej Ey^(M*i,*Wj POI = sup^ | 9%{Xi)\ 
and can estimate \\S\\ P using Lemma 1 (although, formally, it deals with the 
case when the same function is applied to all Xi's, it is easy to see that it 
also covers our situation). Indeed, we have 



sup sup 



SUpEy SUp 
/ 3 



E E ^ E ^xipjihi (Xt , Y)ft (Xi))^ (Y) 

j i 



Proof of Theorem 1. We will proceed by induction with respect to 
d. For d = 1 the theorem is an obvious corollary of Lemma 1 since 

|||(/ii)i| { i } , =EZ, 



■\ 2 



lll(Mi|ll{l}.{l} = SU P jE E (^ 

Y,H{hi)ill^>^msai\hi\ p . 



Let us therefore assume that the inequality is satisfied for all integers smaller 
then d. Let us denote I c = I c \ {d} for / C I d . The induction assumption for 
d\ = d — 1, applied conditionally with respect to X^ d \ together with Fubini's 
theorem, implies that 

v 



(5) nz\ v <*l-i E E 

7C{l,...,d-l} JCI 



id 
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Note that since, in Definition 1, we can restrict the supremum to a count- 
able set of functions, E^IH (J2i d III? j can be estimated by means of Lemma 

2 [applied conditionally on {xf^) k( -j c if I ^ Id-i]- We have 



id 



i 



=p p(#J/2+#(;uM)c) E %u W) c||i(/ ii ) i/u{d} iii? u{4)J . 

>(Ju{d})= 

Moreover, a from the lemma is bounded by |||(^i)i /u{d} |||/u{d},Ju{d} arm 
/ (#J/2+#/C) E^ /2 |IK^).u {d} lll?uM,,u W 



:p p(#(ju{d})/2+#(iu{d}y) 



x E E (/u{d})< 

i(/u{d})c 



■V lll P 
I '' 1 /U{d} III /I 



IU{d},JU{d}- 



Finally, 



= p p(#J/2+#I c )^ E/t 



■V lll p 



l/c 



□ 



Theorem 2. Lei B be a Banach space of type 2. Then there exist con- 
stants Kd{B) depending only on d and the type 2 constant of B such that 
for all p>2, 

r / y/2 

maxErc max y^Er|/i;| 2 ) 
ICI d t- I ^ i 



E|Z| P <1Q(.B) P 



(6) 



+ EE^ (#J/2+#/c)E ^ max ill ill 



ICI d JCI 



As we can see, the aim is to replace the external sums on the right-hand 
side of (1) with maxima. To do so, we will use the following lemmas: 

Lemma 3 ([5], inequality (2.6)). Let £i, . . . ,£jv be independent, nonneg- 
ative random variables. Then for p > 1 and a > 0, we have 

/ \P~\ 



p ap Y,^f <2(l+p a )max 



p Qp Emax£f, E E & 
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Lemma 4 ([5], Corollary 2.2). Consider nonnegative kernels gi'.T, d 
+. . Then for all p> 1 , 



maxE/ max I ^ Ejc^ j < E 



JC/ d 17 Vijc / 

Lemma 5. For a > 0, arbitrary nonnegative kernels g\ : S d — ► M + anci 
p > 1, we /iaue 



p^E^f <K p p° 



p Qp Emax 5 f + 2 p^E/max^E/c^ 
IC{l,...,d} 17 Vijc 



Proof. We use induction with respect to d. For d = 1, the inequality is 
implied by Lemma 3. Assume that the lemma is true for all integers smaller 
than d. Applying the induction assumption to Er 1> ...^-n and using the same 
notation as in the proof of Theorem 1, we get 



P ap ^{dY maxc?f 



/ \P' 



ig{i,...,d-i} 11 Vijc / 



Lemma 3, together with Lemma 4, gives 



K p d _ lP a ^E {dV E d Yp ap ^9f 



id 



< K p p ad p ap Em&xg p + i^p Q,i E {(i}c E d5i j 
<^p a V P Emax 5 f 

^ p^E/max^E/^i) 
7C{l,...,<f-l} 11 Vi/c 



K p ,v ad 
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Moreover, for every I C {1, . . . , d — 1}, by Lemma 3 (applied with "a = 
Lemma 4 and the fact that p^ 1 <p d < K d , we get 

K P d -lP a{d ~ 1] E ^dP* Ip ^i max (y %c3i) ? 

= K^p ^- 1 ^* 1 * ]T E d max ( £ E^A 



\ p 



<iryV /p E JU{d} maxf J2 E 

Vl ( J u{<j}) c 

+ K p d p ad ]T P* JP ^J max (Y KjcgX- 

JCI 1J \irc ) 



V 

(7U{d})<=0i 



□ 



Lemma 6. Let B be a Banach space of type 2. Then there exist constants 
K(i{B) depending only on d and the type 2 constant of B such that for all 
J C I C I d and any fixed value of i/c, one has 



■^jKK^^Y^lM 2 - 
Proof. The Cauchy-Schwarz inequality gives 

ii)ij|||/,j<E/y sup E J Y( c P,J2 hi 



4>eB*,\<j>\<i XJ x , 



< 



Yh 



2 



□ 



Proof of Theorem 2. One starts from Theorem 1, then applies Lemma 5 
for I^hto E i/C iMPOiJI/,./ with "p =p/2" and a = 2(#/ c + #J/2) + 
[taking advantage of the fact that (p/2) ad < K%] and finally applies 
Lemma 6. □ 
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Remark. From Lemma 4, one can conclude that in cotype 2 spaces (so, 
in particular, in Hilbert spaces), the quantity max/c/ d E/c maxi /c IE/|^i| 2 ) p ^ 2 
is indispensable (at least up to constants) since one has 



1 / V 1 / V 

mz\ p > -— E Vl/iil 2 > — maxE/cmax VE/l/iil 2 

1 1 - K d {B)P \Y ) ~ K d {B)P ici d i IC 11 11 J 

with K d {B) depending only on d and the cotype 2 constant of B. 

Let us also consider a corollary of Theorem 2 which is perhaps more "user- 
friendly." It can easily be obtained by replacing 111(^)^111/^, for I ^ I d and 
E|Z| = |||(/ii)|||/ d ,0, with the estimates given in Lemma 6. 



Corollary 1. If B is of type 2, then there exist constants K d (B) de- 
pending only on d and the type 2 constant of B such that for p>2, 

< \ P/2 

E E i^i 2 + E f* JI2 mw Id ,., 

\ i / JCI d ,J^0 

p/2h 



E\Z\ P < K d (B) p 



+ V p p ( d+ # /c )/ 2 E / cma X f E^I^I'V 

ici d iic Kit J 



3. The real-valued case. The purpose of this section is to simplify the es- 
timates of Theorem 2 in the case of real-valued U-statistics. To be more pre- 
cise, we would like to replace the troublesome suprema of empirical processes 
||(^i)i/||/,J by expressions in which the supremum over a class of functions 
appears outside the expectation. To do so, let us introduce the following 
definitions: 

Definition 2. For a nonempty, finite set I, let Vi be the family consist- 
ing of all partitions J = { Ji, . . . , J^} of I into nonempty, pairwise disjoint 
subsets. Let us also define for J (as above), deg(J r ) = k. Additionally, let 
J> = {0} with deg(0) = 0. 

Definition 3. For a nonempty set / C I dl consider J = { Ji, . . . , J k } G 
Vi- For an array (hi) ieI d of real-valued kernels and any fixed value of i/c, 
define 



dc S (J) 

eea^,...,^)) n f-^i^Xj, 



E E I fS ((4 ° W; ) 1 2 < 1 for J = 1, • • • , deg(J) . 

O ' 

Moreover, let ||(fri)i II0 = \h\\. 
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Remark. If / = Id, then the quantity ||(/ii)ij \\j is a deterministic norm, 
whereas for / 7^ 1^ it is a random variable depending on (X^)j ( zjc (one can 
see that it is just an analogous norm, computed conditionally for a sub- array 
of smaller dimension). 

3.1. Real U-statistics of order d = 3. First, we will consider the case 
d = 3. Let us adapt the notation to the simplified situation and write 

n 

Z := ^ hijk(Xi,Yj, Zk), 

ijk=l 

(2) (3) 

where in all previous definitions, Yj,Z k correspond to X-\Xl, respec- 
tively. 

Remark. On closer inspection of Definitions 1 and 3, one can see that 

5> 



1/1/ in/, 



Ei 



< 



■ |2 



i/ll{/} 



and for s € I, IHOOiJI/^} < Moreover, IHOOiJI/,/ = HOOiJj, 

where J is the partition of I into singletons. 

Thus, it follows that to replace all the quantities on the right-hand side of 
(6) by quantities introduced in Definition 3, one must estimate expressions 
of the form 

|||(^jfc)ijfc|||{l,2,3},{l,2} 

= K z sup j £ ^YhijkiXuY^Z^fiiX^ (Yj) : 

I k i,j 

i j ) 

Note that one can choose e m = (e^(Xi), . . . ,e^(X n )), f m = (P m (Yi))i< n — 
orthonormal bases in L 2 (Xi) x ••• x L 2 (X n ) and L 2 (Yi) x ••• x L 2 (Y n ), 
respectively— and denoting a ijk (Z k ) := Y,im E XYh m k{X h Y m ,Z k )e l i (Xi)iJ l (Y rn ), 
write 

|||(^jfc)ijfc|||{i,2,3},{i,2} =Esup< ^^aijkiZ^Xiyj : \\x\\ 2 , \\yh < 1 > 

\ k ij ) 
E ^2( a ijk(Zk))ij 
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It turns out that the problem is to estimate the expected operator norm of 
a sum of independent random matrices (hereafter, we will denote it simply 
by || • ||, suppressing the index Z2 — > fe). 

Before continuing, let us make a few comments concerning the notation. 
First, to simplify it, we are going to suppress the outer brackets when writ- 
ing the norms of Definition 3. For example, we will write ||(^ijfc)||{i}{2,3} 
instead of ||(^jfc)||{{i}{2,3}}- Second, note that any array (a ijk (Z k )) ijk cor- 
responds to an array of kernels (h(gf\gf\ Z k )) ijk = (<Hjk(Zk)9i 9j)ijk, 

where (g\ , 9j^)ij is an array of independent standard Gaussian random 
variables. Thus, for any partition J (as in Definition 3), we can write 
\{a,ijk(Z k )) u \j = \\(hijk)h\\j (where # (1) ,c/ (2) correspond resp. to I (1) ,I (2) 
of Definition 3). The following proposition explains the connection between 
these quantities and the corresponding norms of (hij k )ij k : 



Proposition 1. For any J, we have \\(hij k )\\j = \\(aijk(^k))\\j- More 



over, 



i?fcj||{l,2,3} 



ijk y ijk 



Hjk)\\{l}{2}{3} 



Kj£j||{l,3}{2} 



IK^fc)l|{l}{2,3} 



\ 



sup ^2El^2aij k (Z k )xiyj\ 

|M|2,IM|2<1 k \ ij J 



\ 



sup ^a ijk (Z k ): 
IMh<i i k \ j 



'3 ' 



1 



sup ^2aij k (Z k )xi 
kl| 2 <i j k \ i j 



Proof. This is a simple fact from theory of L2 spaces, so we will only 
show the case J = {1, 2, 3}, just to give the flavor of the proof. We have 

II {1,2,3} = ^2^hi jk (Xi,Yj, Z k ) 2 

ijk 



E z SU P 



£ E x ,y h ijk (Xi , Yj , Z k ) n j (Xi , Yj 



but each (ry)? j= i with EY^n^X^Yj) 2 < 1 can be expressed as 



r 



ij (X i ,Y j )=Y / Pl m eKX i )fi l (Y j ) 

lm 
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with J2im0?m — 1 [th e sum over is i i n general, infinite and the equality 
is satisfied in XijL2(Xi,Yj)]. Thus, 



sup 



sup 

T, P? <! 



sup 

y, pf <! 

Z—/Zm ^ im — 



i.i 



E E Pim®x,Yhi jk (Xi , Yj , Z k )ej (X t ) P m (Yj ) 

Ira ij 



y^,aimk(Zk)Plm 
I in 



E a ijk(Zk 



which already implies that 



ll(^-fc)ll{i,2,3} = / E E%' fc ( Zfe ) 2 - 

Thus, it only remains to be shown that ||(aijfc(-£/fc))||{i,2,3} also equals the 
right-hand side of this equality. However, we have 



\\{a ljk {Z k ))\\ 2 {l2 



{1,2,3} 

sup 

y ijk Er( g m, 9 f ,Z k )*<l 

E ^2 a ijk{Z k ) 2 . 

ijk 



Y^^aijk{ z h)gf 9j rijk(9i i9j , z k) 

ijk 



□ 



We will also need to introduce an analogue of Definition 3 for deterministic 
matrices. Note that we can define the norms ||(aijA;)lli7 f° r an y deterministic 
array (a ijk )ij k by passing through (a i j k g}g 2 j gl) i j k similarly to the way we 
did in the case of {a,ij k {Z k ))ij k . We will, however, follow [9] and give an 
alternate definition which is equivalent, but more straightforward. Although 
this section is devoted to U-statistics of order 3, we will consider a more 
general setting which will also be useful for U-statistics of higher orders. 

Definition 4. Let {a\)- l& jd be a d-indexed array of real numbers. For 
J = {Ji, . . . , J k } £ Vi d , we define 

ll(«i)ib= S np{E«i<---<:E(<) 2 < 1 '---'E(^) 2 <l| 

l i i. h i.J k > 

We then have the following: 
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= E 


f a ^9k J 




\ k J ij 




\ k / ij 


{1}{2} 



Lemma 7 ([9], Theorem 2). Consider a 3-indexed matrix A = (a,ijk) 
Then for any p>2, 



E 



< I|^I|{1}{2,3} + imi{2},{l,3} 

+ 4=I|4|I{1,2,3} + v^PII{l}{2}{3}) • 

Remark. Although using the same notation for || • H^-norms of deter- 
ministic arrays and arrays of kernels seems justified by the aforementioned 
possibility of defining the former via Gaussian chaoses (and also if we in- 
terpret them as norms of multilinear operators on proper tensor products 
of Hilbert spaces), in what follows, we will use Lemma 7 conditionally on 
the variables Z^. To avoid ambiguity, we will write || {aij^Z^Wj^ to stress 
that we mean a norm of a deterministic array obtained by fixing the random 
variables Z\~. 

To proceed, we will need another lemma. 

Lemma 8 ([4], Lemma 7). Let X±, . . . ,X n be independent random vari- 
ables with values in (E, and let T be a class of functions >M such 
that for all i, one has Ef(Xi) = 0. Then 



EsupV/ 2 (Xi) < sup V Ef(Xi) 2 + 32VEM 2 E sup 
/er i fer i fer 

where M := maxjsup^ e -j- 



+ 8EM' 



Now, consider a sequence of independent Rademacher variables e±, . . . ,e n , 
independent of X, Y, Z. Using standard symmetrization inequalities, the fact 
that Rademacher averages are dominated by Gaussian averages and Lemma 
7 conditionally on Z, we then obtain 



E 



. k 

<2E 



Ki 



^ aijk(Zk) 

^ dijk(Zk)£k 



(7) 



< 2, 



-E 



y^,(ijjk(Zk)gk 



<K E||(a Jifc (Z fc ))|| {1}{2i 3 }iD +E||(a iifc (Z fc ))|| {2}i{li3} 



Ki 



D 
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+ -^E||(a ijfc (Z fc ))||{ 1A 3},D + V^ E H(%'fe(^))ll{l}{2}{3},D )• 



Obviously, 
(8) 



y p v p V ijk 



so we are left with the remaining terms. 

Let us start with E||(aiyfc(Zfc))|| m {2}{3}, D- By Lemma 8, we have 



m(aijk(Zk))\\{i}{2}{3], 



D 



= E sup ^2\^2a ijk (Z k )xiyA 

lkl|2,||?/||2<l k \ ij ) 

< sup Ey^l y~]<Hjk(Zk) 
lkll2,||y||2<i k \ ij J 



+ 32VEM 2 E 



2J a ijk{Z k ) 



+ 8EM 2 , 



where M 2 = max fc sup|| a .|| 2i || 1/ || 2 < 1 1 Eij %'fc(^fc)^?/j| 2 = max fc || (ai jk {Zk))ij \ 
We thus obtain 

E||(aj J - fc (Z fc ))||{ 1 }{ 2 }{3} i _D 



< 



E ll( a ijA:(^fe))ll{l}{2}{3},D 



< 



\ 



SUp X! E X! a ijk{ Z k) 
bl|2,||2/||2<l k \ij ) 



\ 



1/2 

Emax||(aj ifc (Z fc ))j i || 2 ) E 



y a ijk{Zk) j 

V A; / 



Now using the inequality v a6 < ^/pa /e + be/ y/p, we finally obtain, for < e < 1 , 

E H (%■*:(-£*;)) || {1}{2}{3},-D 



+ 2v / 2./Emax||(a ijfc (Z fe )) i 



(9) <K 



\ ||x||: 



sup VE Va^f^iii/J 
i.llwlk<i * \ij J 
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+ — E 



v k 



i.l 



+ 



yEmax||(ai ife (Z fc )) ii || 2 



We will now proceed with the term E||(ajjfc(Zfc))||/2}{i,3},.D- 
E||(o i j fc (Z fc ))||| 2 j {1) 3j )D 



E sup ^( ^2a ijk (Z k )yj 
hh<i ijk \ j 

E sup ^ ie kt 
\\vh<i fc \ 



(10) 



\ 



2\ 2 



i \ j / 

< sup E^]{ ^2aij k (Z k )yj) 

Il2/lb<i i,fc \ j / 



+ 32 /Emax||(a i: ,- fc (Zfc))ij|| 2 E sup 



Ibll2<i 













i V j / 



8Emax||(a„ fc (Z fc )) 



where we have again applied Lemma 8, this time to variables X k = (Z k , e k , k) 



and functions f y (Z k ,e k , k) = e k ^J2i(Y,j aij k (Z k )yj) 2 . 

The problem that remains is to estimate the second factor in the product 
on the right-hand side of the last inequality. Let g\, ... ,g n be independent 
standard Gaussian random variables, independent of the Z k 's. We have 









E sup 




Y,(Y. a iJk{Zk)yjj 


IM|2<1 


k \ 


i \ j ) 



< 



-E sup 

llw|[2<i 



E^, 

k 



4 EIE^^M) 

\ i V j I 



In 



-E sup \X y \<2J-E sup X, 



1 y 

1 IM|2<1 



l|y||2<i 



where X y = J2k9k\jJ2iiJ2j a ijk(Z k )yj) 2 is a (conditionally) Gaussian pro- 
cess indexed by the I2 unit ball. The covariance structure of X induces a 
metric on the indexing set, given by 

d x (y,y) 2 =E\X y -X y \ 2 
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= E 

k 

= E 

k 

si: 



A 



i V j 

^2a ijk (Z k )( yj -yj) 



J2[±2 a iA z k)yj) 

i \ j 



2\ 2 



ik \ j / 



dx(y,y) 2 , 



where X y = J2i k 9ikJ2j a ijk(Z k )yj is another (conditionally) Gaussian pro- 
cess (gjfc being i.i.d. standard Gaussian random variables, independent of 
the Z k s). Thus, by Slepian's lemma, we get 

E sup X y < E sup X y 

hh<i hh<i 



< E 



ik 

\ j \ ik / 



< 



\^a ijk {Z k f. 

ijk 



Inserting this inequality into (10) and using the inequality yab< ^fpa + 
b/y/p, we eventually obtain 



E ll( a ijfc(^fc))||{2}{l,3}, 



D 



< 



sup E E E a ijk (Z k )yj 
\ hh<i ik \ j 



(11) 



K 



ijk 



K VP\ / E m , ax 1 1 ( a W ( Z k) )ij 1 1 2 ■ 



By symmetry, 

E\\(a ijk (Z k ))\\ {1}{2 ,3},D < 



sup ^2El^2a ijk (Z k )yi 

\ II 3/11 2 < 1 jfc \ i j 
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(12) 



K 



K^/p JE max 1 1 (a ijk (Z k ) ) y 1 1 2 . 



Inequalities (7)-(9) (with sufficiently small e) and (11), (12), together 
with Proposition 1, yield the following: 

Theorem 3. For any p>2, 
E 



\ k J i 



Z2-Z2 



< K 



1 



— ||(ai ifc (Z fc ))|| {lj2j 3} + ||(a ijfc (Z fc ))|| {1}{2i 3} 

+ ||(ay fc (Z fc ))|| {2 }{l,3} + Vp\\{ a ijk(Z k ))\\{l}{2}{3} 



+ pjEmax||(a ijfc (Z fc )) ii || 2 



In particular, 



ll(^ife)||{l,2,3}{l,2} < K — ;=||(fyjfc)ll{l,2,3} + ll(^yfe)ll{l}{2,3} 



+ ll(^fe)||{2}{l,3} + VPll( /l *ifc)ll{l}{2}{3} 

+ pjM z max\\(h ij k)ij\\ 2 {1 j{ 2 - i 



Now combining Theorem 2 with Lemma 3 and the remark at the beginning 
of the present section, we obtain the following theorem: 



Theorem 4. For any p>2, we have 

p 

hijk {Xi ,Yj,Zk) 

ijk 



E 



<K P 



53 53 pP (dcgU)/ 2 +#n E/c ik^hp 

L/c{i,2,3} JeP/ 1/c 



3.2. i?eaZ U-statistics of higher order. To prove a counterpart of Theorem 
4, we will need estimates for |||(/ii)i|||/ d ,/ d _ 1 =^d\\{J2i d hi)i Id _ 1 \\{{ k }:keI d -i}- 
Note that, again, as for d = 3, by choosing orthonormal bases, we can trans- 
late the problem into one of estimating expectation of the norm of a sum 
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of independent random (d — l)-linear operators by the || • H^-norms which 
satisfy a proper version of Proposition 1. The problem thus reduces to esti- 
mating E\\(Z id o i (Z i(J ))i /d _ i || =E||(Ei d a i( z id))ii i _ 1 \\{l},...,{d-i}- 

Lemma 9 ([9], Theorem 2). There exist constants K d such that for all 
p>2 and any matrix A = (ai) ig jd, 



E 



\ id y 



<K d y: p {i+ ^ j - d)/2 w^)\\j. 



{!},.. .,{d-l} 



Theorem 5. Let Zi,...,Z n be independent random variables with val- 
ues in (T,,J-). For i G N rf_1 x I n , let a; : £ — > M be measurable functions such 
that Kzai(Zi d ) = 0. There exist constants K d such that for all p > 2, we have 



E 



j 



+ K d Yl P 1+(1+dcs ^" d)/2 >ma X ||(a i (Z l J) i \\% 



where \\ ■ \\ denotes the norm of a (d — 1) -indexed matrix, regarded as a 
(d — l)-linear operator on {l2) d ~ 1 (thus the \\ ■ ||{i} v .. i { ( i-i}" norrn * n our no- 
tation). In particular, 



E 



5> 



<K d V p (l+deg(>7)-d)/2 



Proof. As in the proof of Theorem 3, we randomize by an independent 
Rademacher sequence and apply deterministic estimates conditionally on Z 
(Lemma 9) to obtain 



(13) E 



Id 



<i< d y: P il+desJ - d)/2 m< z i d ))\\j,D- 

Jt-Pld 
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Let us consider a general term on the right-hand side of (13), correspond- 
ing to J = { J\, . . . , Jfc} for deg(i7) > 1- Without loss of generality, we can 
assume that d£ J\. We have (again, by Lemma 8, using arguments similar 
to those used in the proof of Theorem 3), for < e < 1, 



p (^)/2 n{a . {Zid)) . 
(l+fc-d)/2 



\ 



E sup 



v EE (s^n^Y 

Uj=2,...,k i d i J 1 \{rf} 3=2 / 



(l+fc-d)/2 



E sup 



M ||(^)|| 2 <l : j=2,..,fc i d I 



I k \2-,l/2>,2 

e E^jn-? 

li Jl\{d} \ { l d \Ji 3= 2 ' 



x \\{ai{Z ld ))\\j 



+ -^-E sup 

||fa, tf hll9<l:.' 









2,...,fc 


*d \ 





+ /Emax||(ai(Z id )) 
e V *d 



d^i Jd l Hji\{d},J 2 ,...,J fe I j 



where for Ji = {d}, we slightly abuse the notation and identify the partition 
{0, J 2 , . . . , Jfc} of id-l with the partition { J 2 , . . . , J k }. 

Now, by Slepian's lemma, we obtain (as in the case d = 3) 



E 



xp r ) )|| 2 <l:3=2,...,fc 



sup 



iJ!\{d} ^i/ d \Ji 



fe \ 2 

(3) \ 



< 2E sup 

„(i) 



^)ll2<l:3=2,...,fe 



3=2 



5X E ^JIK 



3=2 



<K d £ P (1+dC§( ' C) - fc)/2 IE||(ai(^)) i llK:, 

^G-P/ d ,deg(/C)<fc 



D) 



where, in the last inequality, we again used Lemma 9. 
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Note that if J\ = {d}, then Slepian's lemma does not change anything 
(as was the case when d = 3), but in order to shorten the (already quite 
involved) proof, we do not distinguish this case. 

Thus, we obtain 

P a+w)-,)/2 E||(a . (ZiJ)i|U|D 

<^d+de g (.7)-d)/2|| (a . (Z . £i)) .|| i7 

+ K d e £ P^^^ElKa,^)),!!^ 

/CG-P/ d ,deg(/C)<fc 

+ i^ d e~V +(1+dcg(JA{d} " 72 """ 7fc) ~ d)/2 



x ^EmaxIKai^J)^^ ||} AW)j2) ... )Jfc . 

The last inequality remains true for deg( l 7) = 1 (i.e. for J = {Id}) since 
E||(«i(^J)i||{/ d },D<ll(ai(^J)i|| { / d} . 
Summing over all J £ Vi d , we get 



E p {1+d ^ J) ' d],2 n\{a-,{z ld )\\ 



J,D 



<K d J2 p (1+deg(,7) " <0/2 ||(ai(Z i(I )) i || i7 



+ K d e £ p (i+de g (^)- d )/ 2]E | |(a . ( ^ J)il| ^ D 



+ ^ E ^-^-^./EnualKa,^)). 



Taking e sufficiently small, we obtain a bound for the right-hand side of 
(13) which allows us to finish the proof. □ 

Definition 5. We define a partial order -< on Vi as 

if and only if for all I €.1, there exists J E J such that I C. J. 

Using the basic theory of L 2 -spaces and Theorem 5, one obtains the fol- 
lowing: 

Corollary 2. Let! EVi d _ t . Then 



(e^ n 

V id > 
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< E p 

Jev ld -.iu{{d}}-<j 



\J 



+ 



E P 1+(dcs(J) - dcg(X))/2 ,/E d max||(/ ii ) i ||^. 



We would now like to prove Theorem 4 for higher order U-statistics. It 
turns out that instead of using Theorem 2, it is more convenient to follow 
its proof and start the induction argument from the very beginning. 

Lemma 10. There exist constants such that for any p>2, 



(14) 



E 



5> 



< A ^E E E^ (#7C+des(>7)/2)E ^ll(^)ull^- 



Proof. We employ an easy induction argument in the spirit of the proof 
of Theorem 1. For d = 1, (14) is an immediate consequence of Lemma 1 since 



E|X}^i| — y^J^hf = ||(^j)«ll{i}- A s f° r the induction step, one applies the 
induction assumption (conditionally on X^) to J2i d h\, then uses Lemma 1 
and estimates Ed||(Xa ^i)ij|| J (f° r I ^= Id-u 3 € Vi) by means of Corollary 
2 [using the fact that ^E d max Jd Kh)^ \\ 2 j < (E d £ id IK^i)^ □ 

Theorem 6. There exist constants such that for p>2, 



E 



5> 



- J ^ E E p p(#7C+des(>7)/2) 



E/c max | 



l i)i/llj r - 



Proof. To replace the sums in i/c on the right-hand side of (14) with the 
maximum over ijc, it is enough to use Lemma 5 for kernels g 1[C = || (/ii)i/ 1| 
with p/2 instead of p and a sufficiently large and to notice that for J C I c 
and J e V u we have E^j^^ IK^OiJ^ < II fata ||f Jc} - □ 

3.3. Tail estimates for bounded kernels. Chebyshev's inequality gives the 
following corollary of Theorem 6: 

Theorem 7. Assume that all the kernels h\ are bounded. Then there 
exist constants such that for all p>2, 



>^E E? 

ici d jeVi 



#/ c +deg(J)/2 



max 



Oi/llj-lloo 



<e~ p 
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or, equivalently, for all t > 0, 



> t < .fQ exp 



1 



mm 



t 



x 2/(dcg(J)+2#7 c )-| 
#d IQiZjGPl V 1 1 1 1 (h)i z 1 1 .7 1 1 oo / 



Remark. The above theorem is, in a sense, optimal. The recent in- 
equalities for Gaussian chaoses by Latala state that for hi = a\g^ • ■ ■ g\ d ^ , 
we have 



5> 



5> 



>k d e / esm/2 ii(^)ib 



>^ E p' 



degm/2. 



> k,i f\e~ 



< e 



which shows (together with the CLT for U-statistics) that apart from con- 
stants, the components p(# IC+dc s(J')/ 2 ) || (h\)\ I \\j for I = Id are correct and 
cannot be avoided. To discuss the appearance of other components, let us 
consider a product V = G]J ieI Xi, where the X^s and G are independent, 
the Xi's are centered Poisson random variables with parameter 1 and G = 
J2i, c x iic IL"e/ c 1S a Gaussian chaos (</■ are i.i.d. standard Gaussian). 
Then V is the limit law of U-statistics V n with kernels riie/ -^nlj a n,i 7 c Tljgi 9^ 
(i G J^), where are centered Bernoulli random variables with parameter 
p = l/n and where the coefficients properly chosen (from the infinite- 

divisibility of Gaussian variables or by interpreting G in terms of mul- 



dcg(J)/2| 



iic)\\J. 



> 



tiple stochastic integrals). Then P(V > kdOtpY^jeVrcP 

1 f~H~I 

kd A e~ p , where a p loga p ~ p, which shows that the other summands are 
also correct, at least up to a factor of order (logp)* 7 . 



(7) 

Further, note that if Xf are i.i.d. random variables and h\ = h for some 
function h, then the quantities appearing in the above theorem simplify, 
namely ||||(^i)j r || l 7||oo = ri& I / 2 \\ \\h\\ j\\oo- Thus, we obtain the following: 



Corollary 3. Ifh\ = h and Xf are i.i.d. random variables, then for 
any t > 0, we have 

I / t X 2/(dcg( l 7)+2#/ c ) 

; 



> t ] < Kd exp 



mm 



K d iQld.J&vAn* 1 / 2 



J Woo. 



Remark. In particular, we can see that the tail of the U-statistic gen- 
erated by a fixed bounded canonical kernel is of order n d l 2 which agrees 
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with the CLT for such U-statistics. It is also worth pointing out that each of 
the above theorems has its "undecoupled" version which can be immediately 
obtained by applying the decoupling results by de la Peha and Montgomery- 
Smith [11]. 

4. Multiple stochastic integrals with respect to stochastic processes with 
independent increments. Theorem 6 also yields tail estimates, in the spirit 
of Theorem 7, for some multiple stochastic integrals (see, e.g., [8] for the nec- 
essary definitions). Namely, let (-^ )te[o,T] (* G Id) De independent cadlag 
stochastic processes with independent increments, = 0. Let V l (t) = 
VarTVj < oo. Moreover, let A*(t) =EiV t be the compensator of and 
define N®(t) = N(t) - A(t). Finally, assume that all the jumps of arc 
uniformly bounded, say by 1, since this is just a matter of normalization 
and the typical example we have in mind here is the (not necessarily homo- 
geneous) Poisson process. 

Definition 6. For a nonempty subset I C I d and J = { Ji}f =1 G Vi, we 
define the quantities 



We further define \\h\\ = \h\. 

Notice that as in the case of U-statistics, \\h\\j is a norm when 1 = 1^. 
Moreover, for I ^ Id, it is a function of 

We then have the following: 

Theorem 8. Let h : [0, T] d — >• R be a bounded Borel measurable function. 
Consider the stochastic integral 






Then there exist constants such that for all p>2 
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We would like to approximate h by step functions and the stochastic 
integral by proper U-statistics (or even homogeneous chaoses). However, 
the best approximation we may hope for is in L 2 and almost sure, whereas 
in Theorems 7 and 8, we have some L°°-norms. Thus, we must be careful 
and approximate by step functions h n for which those norms are bounded 
by the corresponding norms of h. We will use the following: 

Lemma 11. Consider probability spaces i < d, and = 

Xi=i,...,d^i; \i = ®i=\ dl^i- Then there exist constants such that for 
every e > and every measurable subset ACQ with /J-(A) > 1 — e, there ex- 
ists a subset B C A such that fJ,(B) > 1 — K^e 1 / 2 and for all I C 1^ and 
xj G Xjg/Oj, we have either B! Xi = or fijc(B Xi ) > 1 — K^e 1 ! 2 " 1 1 , where 
A*/ c = <S>; G /c Mi and B I Xi = {yjc G X jg/cOj :y£B,y I = x I }. 

Proof. Let us first make a comment concerning notation. We will be 
using induction and, in the process, will be dealing with various subsets 
C Q X j e /Oj for / C I d . In such a situation, for J CI and xj G X jgjfij, we 
will denote the set {yj\j G Xiei\j^i-Vl &C,yj = xj} by C J X] , which may 
be slightly inconsistent with the notation in the statement of the lemma. 
Moreover, when writing Cartesian products of several sets, we will pay no 
attention to the order (regarding the Cartesian product as the set of func- 
tions defined on the indexing set and thus making it "commutative"). 

Let us now proceed with the proof. For d=l, the statement is obvious. 
Let us thus assume that it is true for all numbers smaller than d > 1 . For 
0^1 Cl d , let Aj = {xj G X ieI n i :fi I c(A I Xi ) > 1 - y/e}. Then by Fubini's 
theorem, we have ^tj(Aj) > 1 — *fi and by the induction assumption, there 
exist sets Bj C Aj with ^lj(Bj) > 1 — K^-ie 1 ^ 2 and such that all their 
sections are either empty or of measure greater than 1 — IQ-ie 1 / 2 1 . Now, 
let 

b = n u n (Bix(xsu))nA. 

We have n(B) > 1 — K^e 1 ^ 2 ' 1 1 . Let us consider J C I d and arbitrary xj. 
Then 

B J XJ ={yjo:yeB, yj = xj} 

(15) 

= H \yjc--y£ |J {zi} x A I Zl ,yj = x J y 

We will show that B x is either empty or of measure greater than 1 — 
Kd£ l / 2d 1 ■ Assume that there exists xjc G B x . Let x be the element of 
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X jgi^Qj given by the "concatenation" of xj and xjc Then x G B and thus 
xj G for all / C 7 rf . Thus, for In J c / 0, we have x/ n j c G (^l)i^j ' so 
set is nonempty and, as such, by the definition of Bj, is of measure greater 
than l-Kd-xe 1 ' 2 . Let us now define 

u = A J XJ n p| fx ^x(£ 7 )™ ). 

lci d ,inJ c ^0 VeJ c \/ / 

Clearly, fijc(U) > 1 — -fr^e 1 / 21 * 1 since all the intersected sets are of measure 
greater than 1 — Kd-ie 1 / 2 1 (including A XJ , since xj G £ / C Aj). Now, for 
xjc G [7, we have x £ A (where x is again the "concatenation" of xj and 
xjc). Moreover, for I n J c 7^ 0, £/nJ c £ an d thus G From 

the discussion following the assumption that B XJ is nonempty, this is also 
the case for ^ I C J. Hence, for any 7^ J C 7 d , we have x G {x/} x A XI 
with G -B/ and so from (15), we have xjc G B x . We have thus proved 
that U C fi^ which implies that fij^B^) > 1 - IQe 1 / 2 ^ 1 . □ 

Lemma 12. There exist step functions, that is, functions of the form 



h n - a i n)l ( t (r 

K 7] 



suc/i £/iai /i n — > /i a. e. and in L 2 wii/i respect to the product measure on 
[0,T] d with marginals determined by V 1 and \\ \\h n \\ j\\oo < 3|| j"||oo f or a ^ 
ici d and J e Pi. 

Proof. First, note that if we replace iVM with aN^\ then \\h\\j multi- 
plies by IliGj" c i > so without loss of generality, we can assume that V"W (T) = 1 
which will allow us to use Lemma 11. Consider any sequence h n of step func- 
tions converging a.e. to h with ||/i n ||oo < 1 1^1 loo- For any / C J d and J~ £Pj, 
we have H^nll.7 - *• INI J a - e -j thus we can pass to a subsequence and assume 
that for a large subset Ajl [say (A^) c with measure smaller than e/2 n2<i 1 , 
e to be chosen later] , we have || h n || j < 2 1 1 1 1 1 1 ^7- 1 1 . Then let B (n) be the sub- 
set of [\i{Af) x [0,T] 7 ) given by Lemma 11 applied to the cr-field generated 

by sets of the form ,^[+1] x • • • x (t^ , 4?+i]> where the t\ n ^ correspond 
to the step function h n , as in the formulation of the lemma. Define for 
t= (t 1 , . . . , td) , h n (t) = h n (t ) l B ( n ) (t ) . Then h n is a step function and by the 
Borel-Cantelli lemma, we still have h n —>h a.e. and in L 2 (by the Lebesgue 
dominated convergence theorem). Moreover, for all I and tic, the function 
9n(ti) = h n (t) either equals or differs from h n on the set of measure not 
greater then iQe 1 / 2 '* 1 /2 n . If g n does not equal 0, we have tic G A^ and 
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thus \\h n \\j < 21111/illj-Hoo at i/c Thus, \\h n \\j = or \\h n \\j < \\h n - h n \\j + 

\\~h n \\j < K d (\\h\\oo + ||/i„||oc)£ 1/2 72 n/2 + 21111/iblU < 31111^ || oo for e suf- 
ficiently small. □ 

Proof of Theorem 8. We will prove moment inequalities for stochas- 
tic integrals of bounded kernels. These will imply the theorem by the Cheby- 
shev inequality. Consider functions h n , given by Lemma 12. We can assume 
that maxj<fc n — tf 1 \ — > n 0. Let Z n be the ci-fold stochastic integral of 
h n . Since h n — > h in L 2 , we have Z n — > Z in L 2 and we can assume that 
Z n — ► Z a.e. Let us now (with a slight abuse of notation) denote by \\Z n \\j 
the || • ||j--norms of the matrix of kernels which define the homogeneous 
chaos Z n viewed as a U-statistic (to distinguish them from ||/i n ||j r given in 
Definition 6). One can see that for J € Vi d , we have \\Z n \\j < \\h n \\j and 
for / C I d , J G Vi, any fixed value of i/ c and each tjc £ X £ e jc(i^ ,t^j 
we have 



\Zn\\j<\\h n \\j II I^S -^(S 



where H/inll.7 ° n the right-hand side is taken at the point tjc. Thus, by 
Fatou's lemma, Theorem 6 and the definition of h n , we get 

E | Z | p = E lim inf I Z n \ p < lim inf IE I Z n \ p 



< lim inf W J2 ^^WKfj 
\jev ld 



+ E E ^ (#/c+dog{:7)/2) 



xE.cmaxllll^ll^ll^ J] " 



<^E E p p(#/c+deg(>7)/2) iiii/tb ||f 



oo 



x E/c lim sup max TT I - jV^JJ 

<^E E p #/c+dcgU)/2 iPbiroo, 

where, in the two last inequalities, we have used the assumption that the 
jumps of jV< fc > are bounded by 1 (since the lim sup is then also bounded 
by a constant and, moreover, the processes N^ k > have all moments, which 
together with Doob's inequality allows us to use Fatou's lemma for lim sup). 
□ 
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